Learning Elastic Stack 6.0 by Pranav Shukla

Author:Pranav Shukla
Language: eng
Format: mobi, epub
Tags: COMPUTERS / Data Modeling and Design, COMPUTERS / Data Visualization, COMPUTERS / Data Processing
Publisher: Packt
Published: 2017-12-21T06:02:15+00:00

Building Data Pipelines with Logstash

In the previous chapter, we understood the importance of Logstash in the log analysis process. We also covered its usage and its high-level architecture, and went through some commonly used plugins. One of the important processes of Logstash is converting unstructured log data into structured data, which helps in searching for relevant information easily and also assists in analysis. Apart from parsing the log data to make it structured, it would also be helpful if we could enrich the log data during this process so that we can gain further insight about our logs. Logstash comes in handy for enriching our log data, too. Also, we have seen in the previous chapter that Logstash can read from a wide range of inputs and that Logstash is a heavy process. Installing Logstash on the edge nodes of shipping logs might not always be feasible. Is there an alternative or lightweight agent that can be used to ship logs? Let's explore that in this chapter as well.

In this chapter, we will be covering the following topics:

Parsing and enriching logs using Logstash

The Elastic Beats platform

Installing and configuring Filebeats for shipping logs

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.